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Abstract 



This kindergarten through grade 2 program, 
intended tc prevent the development cf educational 
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Effective Schools and the All Day Neighborhood Schools 
programs in order tc (1) increase the academic level cf 
children in poverty areas, (2) involve the parents in that 
primary objective, and (3) provide liaison with ether 
grades in school. Class size was reduced tc 15 pupils for 
kindergarten and first grade, and tc 20 for the second 
grade. The fiye special primary schools served a tctal of 
2,336 children, 99 percent of whom were Negro, and one 
percent Puerto Rican. No systematic quantitative 
differences were found between performance in these schools 
and the several baseline comparison schools. However, the 
improved qualitative benefits resulting from reduced class 
size suggest definite advantages potentially accruing to 
the facilities cf the Special Primary Program. Sample 
questionnaire and interview forms used in the evaluation 
are appended. (EM) 
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CHAPTER I 



PURPOSE OF THE REPORT AND DESCRIPTION OF THE PROJECT 



A. Purpose of the Report 

The purpose of this report is to evaluate the Special Primary 
Program (SPP) in Five Schools. The program proposes to utilize 
the main features of two existing programs, the More Effective 
Schools (MES) and the All Day Neighborhood Schools (ADNS), in 
order to increase the academic level of children in poverty areas 
and to involve the parents in that primary objective. 

B. Description of the Project 

The Special Primary Program (SPP) as originally described by 
the Board of Education in September 1968, aims: 

1. To raise the academic level of children. 

2. To involve parents in the reading program. 

3. To provide liaison with other grades in school. 

To achieve these objectives, the following specific implemen- 
tations are proposed: 

1. A reduction, in class size to 15 pupils for kindergarten 
and first grade, and to 20 for the second grade. 

2. An increase in the size of the teaching staff by the addi- 
tion of early childhood teachers and grade coordinators. 

3. An increase in the psychological and guidance services 
along with the use of paraprofessionals who live in communities 
around the five schools. 

4. Assignment of subject-matter specialists to facilitate the 
program as well as to participate in the After School Study Center 
a two-hour extension of the school day. 

The Board of Education described the program as follows: 

"in effect, the program in these five schools will 
combine the significant features of MES and ADNS in 
a massive effort: to raise the academic level of 

the children in poverty areas by special emphasis 
on a preventive program in prekindergarten through 
grade two; to involve parents in a meaningful way 
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so that they may become partners in promoting opti- 
mum academic achievement; to provide liaison with 
other grades in school so that an ongoing program 
of academic emphasis may be maintained." 

The expansion of the school day, from 9 A,M. to 5 P.M., with 
an enlarged teaching staff and school aides, so as to provide 
additional instructional, remedial, and recreational facilities, 
is based on similar provisions in the AMS program. Other fea- 
tures, including increased guidance and psychological services, 
and provision of special teaching and other personnel are charac- 
teristic of both the MES and the ADNS programs. 



CHAPTER II 



EVALUATION DESIGN 



A . Evaluation Design and Goals 

In line with the objectives, goals, and procedures of the Spe 
cial Primary Program, the evaluation design calls for the follow- 
ing steps: 

1. A determination of the extent to which the program as out 
lined in the initial project description is actually in operation 

2. An assessment of the children, including consideration of 
academic achievement and progress in acquisition of knowledge, 
comparison with children not included in this Special Primary Pro 
gram, and indications of the children's participation in and re- 
actions to the program. 

3. A report on staff performance covering the role of teach- 
ers in the classroom, the role of the grade coordinators, the 
function of the various aides, specific coordination features of 
the program, and reactions of staff and administrative personnel. 

4. An evaluation, obtained by interviewing selected parents, 
of parental involvement in and reactions to the program. 

5. An examination of liaison with other grades and the role 
of the grade coordinator. 

6. An evaluation of the implementation and functioning of 
the After School Study Center through observation and interviews 
with administrators, teachers, and parents of children involved. 

7. An examination of the planning for the program. 

A brief comment is warranted concerning the more immediate 
goals of preschool and early- school intervention programs in 
terms of ultimate objectives. The first objective involves a 
"bootstrapping" operation of cultural, artistic, and literary 
enrichment to bring the economically and culturally impoverished 
child somewhat nearer the level of the middle-class child. This 
phase involves teaching the child specific skills and reactions 
to particular stimulus materials . Over and beyond that acquisi- 
tion, there would seem to be a more generic, ultimate goal, 
namely, instilling in the child the habit of learning to learn 
and to generalize or transfer . The child would then, on his own, 
seek out knowledge and carry over habit patterns from past expe- 
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The Special Primary Program, in some of the schools, follows 
along the lines discussed, with emphasis not only on the acquisi- 
tion of specific skills, but also on building the more general 
habit patterns. 

B. Areas for Specific Evaluation 

Data were collected in the following areas : 

Academic achievement of the children . Here the Metropol- 
itan Achievement Tests (MAT) were employed in grade two, and the 
Gates -MacGinitie Reading Tests (GMRT) in grades one and two. 

2 * Development achievement of the children . The New York 
Child Development Scales (CDS) were administered in prekinder- 
garten, kindergarten, and grades one and two. 

3* Implementation of the program . An interview guide for 
use with principals and assistant principals was developed to 
obtain this information, 

^ • Parental participation . A special Parent Inventory was 
developed that was supplemented by information from the princi- 
pals and the teachers. 

5* Community involvement . Information on this point was ob- 
tained from principals and staff. 

6* Teacher reaction . A Teacher Questionnaire was constructed. 
In addition, the Individual Lesson Observation Report was taken 
over from MES 1 and employed to gather information about both teach- 
ers and children. 

7. After School Study Center (ASSC) . An A SSC Observation 
Guide was developed and supplemented by interview information from 
the principals and teachers. 

C. Description of the Specific Instruments 

1* Nine specific comparison schools . The five Special Pro- 
gram Schools were compared among themselves, but it was considered 
efficacious to make external comparisons of test performance with 
schools not involved in this program. The design for analysis 
involved selecting schools geographically and ethnically similar 
to each of the five SPP schools. Thus, an attempt was made to ob- 
tain an essential baseline for each school from which the effects 



'Vox, David J 
gram , (New York: 



•> Expansion of the More Effective Schools Pro- 
Center for Urban Education, September 1967). 
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of the special program could be assessed. Nine such schools in all 

* were selected. 

Because information for all nine schools was not complete, it 
was necessary to use different groups of schools for different data. 
Five paired comparison schools were used for analysis of MAT scores. 
Five were used for analysis of the Gates-MacGinitie scores. In one 
comparison school, both scores could be analyzed. Thus, data from 
all nine paired comparison schools were examined. 

2. Metropolitan Achievement Tests (MAT) . This widely used 
achievement test is described by its authors as follows: 

’’This general achievement series offers com- 
prehensive and dependable measurement of 
the progress of a pupil through his entire 
elementary school career, providing an anal- 
ysis and record of his developing mastery 
of essential skills and information. 

"Thorough analysis of current courses of 
study and instructional materials, and of 
4* the thinking of professional leaders in 

v elementary education, identified the ob- 

- jectives to be measured. More than 15j000 

test exercises, all prepared especially for 
these forms, were developed to meet rigor- 
ous specifications. Experimental tryout 
furnished the empirical basis for selection 
of test material. 

"Test scores are made meaningful through 
conventional grade equivalents, percentiles, 
or the simplified stanine scores. These 
scores point directly and quickly to pupil 
status in the skill or content areas, and 
suggest appropriate types of instructional, 
curricular, or guidance action." 

Word -knowledge and reading scores along with the average of the 
two measures were obtained in raw and grade- equivalent units from 
the school rosters provided by the Board of Education. Since the 
two individual scores correlated substantially, only the average 
grade- equivalent score was employed in analysis. The MAT was ad- 
ministered to all second-grade pupils in April 1968, and the rosters 
became available for statistical treatment in late May. The com- 

* pari son schools were used as measures. 

'--i* 

3. The Gates-MacGinitie Heading Tests (GMRT) . This instrument 

* was employed with the first and second grade of the five SPP Schools. 
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It consists of two basic parts: Vocabulary and Comprehension. 

These are described by the developers as follows : 

"The Vocabulary Test samples the child's abil- 
ity to recognize or analyze isolated words. 

It consists of 48 exercises, each of which 
contains four printed words and a picture 
illustrating the meaning of one of the words. 

The child's task is to circle the word that 
best corresponds to the picture. The first 
exercises are composed of easy and commonly 
used words, grouped with words selected to be 
only slightly similar or confusing. Gradually 
the words become less easy and common and are 
presented with words more similar in details 
and general appearance . 

"The Comprehension Test measures the child's 
ability to read and understand whole sentences 
and paragraphs. This ability includes many 
skills not involved in the mere ability to 
recognize words. The child must grasp the 
total thought clearly if he is to answer cor- 
rectly . The test contains 34 passages of 
increasing length and difficulty. Each pas- 
sage is accompanied by a panel of four pictures. 
The child's task is to mark the picture that 
best illustrates the meaning of the passage or 
that answers the question in the passage." 



As in the case of the MAT, comparison schools were selected 
so that a baseline was potentially available from which to mea- 
sure any effects of the SPP. 



The Gates-MacGinitie Reading Tests were administered at sev- 
eral SPP schools in February 1968, but since data were not avail- 
able for all SPP and the comparison schools, this information 
could not be used as a preprogram measure. 

4; New York C hild Development Scales (CDS) . 2 This scale has 
much in common with the Vineland scales-^ for assessing developmental 
maturity in infants and preschool children. It also relates to the 



2 New York Child Development Scale, (Board of Education of the 
City of New York, Bureau of Educational Research, 1950). 

3 

Vineland Social Maturity Scale, (Educational Testing Service 
1953) • 3 
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Gesell scales for early childhood behavior. It is not a measure 
of academic achievement, but rather focuses on gross development 
in language, motor activities, interpersonal relations, and inde- 
pendence. Thus it is designed for assessment of individ ual 
strengths and weaknesses in areas that form the context in which 
academic achievement progresses. As such it was thought that the 
CDS might throw light on behaviors related to academic achievement, 
but not directly reflected in the instruments employed to measure 
it . 
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The instrument is described in the manual as follows: 

"in order to plan a program to meet the child’s needs, 
the teacher tries to find out all she can about him... 
The New York Child Development Scales have been con- 
structed to help her make systematic observations of 
the child’s behavior in a few selected areas and to 
help her utilize these observations in planning his 
program and guiding his growth. Four scales are avail- 
able: 



Scale A : Personal Independence 

Scale B: Interpersonal Relations 

Scale L: Language 

Scale M: Motor Development 

"The scales are designed for use with individual chil- 
dren of chronological ages four through seven. Each 
scale yields a rating for the child in comparison 
with children of his own age. The possible ratings 
are: (1) Markedly Above Average , (2) Above Average , 

(3) Average , (4) Below AverageT (5) Markedly Below 
Average . Scale A: Personal Independence and Scale 

B: Interpersonal Relations measure closely related 

aspects of development and may be used as a unit. 
Scale L: Language and Scale M: Motor Development 

are more independent instruments and may be used 
separately or in conjunction with the others." 



The original plan was to have the CDS executed by two indepen- 
dent teachers on a randomly selected sample of 15 children from 
each level (pre-K, K, 1, and 2) for each of the five SPP and five 
control, baseline schools. In practice, only one comparison school 
could be obtained and, in the SPP schools, various complications 
arose that will be noted later . 
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Gesell Developmental Schedules, (Psychological Corporation, 

1949 ). 
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A basic point is clear: some measure of behavior outside and 

independent (at least in part) of the direct achievement context 
is needed. It was hoped that the CDS would provide a small spring- 
hoard from which increased efforts in this direction would take off. 
The ideal, of course, is assessment of the habits of learning and 
generalization . 

5. Principals Interview Outline . The complete guide to in- 
terview of the principals and assistant principals is provided in 
Appendix 3 , The focal point of the interview was a determination 

of the degree of implementation of the Special Primary Program. That 
is to say, the aim was to find out concordance between the stated 
goals and budget specifications on the one hand and actual practice 
on the other. Specific questions concerned, for example, staff, 
their allocation and function, the role of the grade coordinator, 
the function of the clinical team, community relations and parental 
involvement, and the ue bails of the After School Study Center. All 
principals were interviewed at least twice and in several instances 
as many as six times. In addition, assistant principals and grade 
coordinators either were included in the principals* interviews or 
were interviewed separately at all five schools. 

6. The After School Study Center (ASSC) Guide . The principal 
and other participants in the ASSC were interviewed in depth con- 
cerning the details of the ASSC program. Such information was 
sought as the nature of the supervision, content and participation 
in the ASSC, parental involvement, and administrative provision 
for evaluating the program. Observations were made in the ASSC 
setting . A copy is included in Appendix B . 

7. Parent Inventory . This instrument dealt directly with pa- 
rental participation in the regular school program and/or in the 
ASSC. It also sought to find out about parental knowledge of and 
participation in specifics such as the child *s homework. A copy 
of this inventory is contained in Appendix B . Ten parents at each 
school were asked to execute this inventory. 

8. Teacher Questionnaire . This was in part an adaptation of 
a measure developed in one of the schools and was administered to 
all second-grade teachers at each of the five schools. Its purpose 
was to obtain demographic information regarding teaching experience, 
reactions to various aspects of the Special Primary Program, and 
some regular classroom feedback on those children who were partic- 
ipating in the ASSC program. 

D. Basic Factors Contaminating Research Design: Turnover, Con- 

founding, and Unavailability of Pretesting Data 

Before describing the five schools involved in the Special Pri- 
mary Program, three basic problems require discussion. They are 



9 



basic because they not only restrict evaluation and assessment but, 
in a very real sense, can operate to prevent or at least drasti- 
cally limit the functioning of such a program. 

The first is turnover or motility or mobility. The concept has 
reference to the shifting nature of the -within- school sample under 
evaluation examination. It is close to complete redundancy to com- 
ment that a child "who comes into the program the day before a mea- 
sure of program effect is applied, is in no way comparable to a 
child who has been in the program throughout the school year. 
Clearly, it behooves the evaluator to consider the status of the 
child in this regard. If the program has any behavioral impact as 
indicated by performance on any measure, the child must have had 
at least minimal exposure to the potential influence of the program. 
Otherwise it is meaningless to discuss the effects of the program. 

There is another, possibly more subtle aspect to the turnover 
problems, namely, teachers. Participating in the program with one 
teacher is not the same as participating with a new teacher, or a 
series of teachers. Adherence to the principle of a "stable 
sample" may greatly restrict the size of the sample, but it would 
allow relatively pure effects of the program under scrutiny to 
emerge . 

The second problem is the matter of confounding different pro- 
grams, which is even more complex than that of turnover. The term 
"confounding" is used to designate the situation in which more than 
one program is operating in such a way that the separate effects 
of each program cannot be disentangled. Suppose, for instance, one 
school is endowed with program A, a second school with A plus B, 
and a third with A plus B plus C . If differences emerge when the 
three schools are compared with the appropriate baseline control 
schools that lack all three programs, they cannot be clearly attri- 
buted to the effects of any particular one of the three programs. 
Some statistical refinement may help, but in the more complex case 
where half a dozen programs are involved to varying extents, no 
amount of statistical manipulation will clarify the picture. 

Third, a beforehand measurement is essential so that gain 
scores can be statistically examined. Such gain scores are basic 
to the assessment of any academically oriented program in provid- 
ing proportional changes in knowledge and skill from each child* s 
own baseline. Since gain scores were not available, it affects 
ability to evaluate. 

Matters such as these will be treated in the report, but it 
should be stressed at this methodological point that such obstacles 
should be removed at the program planning stages and not left to 
becloud the evaluations. 
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E. Criteria of Change 

The immediate effects of an intervention program can be mea- 
sured during and immediately after completion of intervention. 
Intermediate criteria are also available, such as the degree to 
which the acquired behavior generalizes and/or transfers to near 
or remote situations along some similarity continuum, situational 
or reactional. More ultimate criteria must, of course, be consid- 
ered. These are usually quite removed in time from the original 
intervention. For instance, one might expose infants to increas- 
ingly complex environmental stimulation, building in more complex 
reaction patterns. The investigator would have immediately at 
hand the performance of the child, and he could test, over a 
period of time, for transfer in a variety of increasingly dissimi- 
lar situations. In the long pull he is obligated to check, for 
example, the child* s school performance against those of children 
not given the early -life treatment. 

In this context, we are here dealing with the immediate effects 
of the Special Primary Program, not with the long-range maturation 
of influence. The latter is a matter for future evaluation. 

F. Demographic Description of the Five Special Primary Program 

Schools 

Table 1 summarizes certain demographic features of the five 
schools involved in the Special Primary Program. (SPP schools 
(five] are coded A through E; comparison schools [nine] , F through 
N.) The outstanding feature of this table is diversity. Marked 
differences among schools appear in almost every regard. The 
schools were, however, homogeneous in regard to socioeconomic 
status, with most children in all schools drawn from families to- 
ward the lower end of the scale. They were also similar with re- 
gard to turnover in pupils. The ethnicity figures of this table, 
along with geographical location, were employed in selecting match- 
ing schools for comparison on certain measures, such as the MAT and 
the Gates -MacGinitie Tests. 
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TABLE 1 



DEMOGRAPHIC CHARACTERISTICS OF THE 
FIVE SPECIAL PRIMARY SCHOOLS 
OCTOBER 1967 8, 





A 


B 


C 


D 


E 


Total 


Latest Enrollment 




* - 










Spring 1968 


Pre-K 


59 


55 


59 


0 


23 


19 b 


K 


215 


156 


135 


82 


71 


659 


1 


294 


172 


123 


94 


55 


738 


2 


275 


187 


129 


90 


J2 


7^3 


Total 


843 


570 


1*6 


266 


211 


2,336 


Pupil Turnover Rate 
Based on Opening 


Register 


187 $ 


47 * 


113% 


129 * 







(Pre-K through Gr. 2) 



ASSC Register 
ASSC Attendance 


125 


220 


330 


225 


200 1,100 


(Grades 2-6) 


66$ 


30]t 


66* 


67 * 


30$ 



Ethnicity 



Negro 


64* 


92* 


81* 


55* 


99* 


Puerto Rican 


34.5* 


8 * 


19* 


22* 


1* 


Other 


1.5* 


0* 


0* 


23* 


0* 



a Board of Education, Ethnic Survey of October 1967 . 



G. Recapitulation 

The focus of the Special Primary Program in Five Schools was on 
increased academic achievement by adding teachers and grade coordi- 
nators. Parental involvement was sought. Two kinds of evaluation 
were involved: quantitative by way of standardized tests and in- 

ventories and qualitative by interviews and questionnaires. Observa- 
tions were employed for both. Special considerations include the 
goals of the program, the appropriateness of the measures, change in 
performance over time, turnover, confounding, and long-range assess- 
ment of program effects. 
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CHAPTER III 

FINDINGS: QUANTITATIVE MEASUREMENTS 



■A* The Metropolitan Achievement Tests in the Second Grade 

The MAT was administered to a total of 653 students in 33 sec- 
ond-grade classes in the five SPP schools. As noted, previously, 
comparable schools that did not involve the SSP were selected on 
geographical and ethnic bases. From these schools a sample of 38 
second-grade classes involving 864 pupils was selected. The median 
number of pupils per class in the two sets of five schools was 
about the same (18) , but the spread in class enrollment was appre- 
ciably different. The range in the five SPP schools was from six 
to 32, while the corresponding figures were 11 to 58 in the five 
comparison schools. For various reasons beyond our control the 
numbers in Table 2 do not always agree with these figures. Some 
classes were removed from consideration in the interests of a more 
stable sample. Pupils who were in the school for too brief a 
period to be considered as part of the stable school population 
were also eliminated frcm the analysis. In order to achieve a 
relatively stable sample, classes were excluded that contained 
fewer than ten students. 

Of possibly greater import, only those classes in the SPP 
schools were included for analysis where the children had been in 
the program for most of the school year. Spot checking of teacher 
turnover suggested that it was relatively small in this situation 
and therefore played a minor role. 

Unfortunately, this care in sample selection could not be ap- 
plied to the comparison schools. While this factor is not to be 
overlooked as a potential source of uncontrolled variation, the 
outcome as shown below is such that it appears to have made little 
difference . 

Table 2 contains a summary of the data from the administration 
of the MAT in the second grade of the five SPP schools and the 
five comparison schools. To simplify presentation, the mean grade 
equivalents are given for the highest, medial, and lowest class in 
each school. Overall figures for the two sets of five schools are 
included (the SPP schools and the non-SPP schools). 

It is clear from this representation that (given the critical 
qualifications of the material) the two sets of five schools per- 
formed at about the same level in the middle range with a very slight 
tendency for the SPP school pupils to score a little higher at the 
lower and upper groupings. These trends are extremely slight and de- 
tailed statistical analysis revealed no significant findings in the 
data of Table 2 or the data for all classes from all ten scho ol s • 
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TABLE 2 



METROPOLITAN ACHIEVEMENT TEST MEAN GRADE EQUIVALENT SCORES 
IN THE SECOND GRADE IN FIVE SPECIAL PRIMARY PROGRAM 
SCHOOLS AND FIVE COMPARISON SCHOOLS 



School 


FIVE SPECIAL PRIMARY PROGRAM SCHOOLS 

Highest Middle Lowest 

N Class Class Class 


Number of 
Classes 


A 


208 


2.52 


1.83 


1.45 


9 


B 


105 


3.61 


2.33 


1.70 


5 


C 


84 


2.81 


2.09 


1.97 


6 


D 


77 


3.06 


2.45 


1.95 


3 


E 


84 


2.71 


1.88 


1.83 


3 


Overall 


558 a 


2.81 


2.09 


1.83 


26 




FIVE NON-SPECIAL PRIMARY PROGRAM SCHOOLS 




F 


159 


1.94 


1.84 


1.64 


3 


G 


54 


2.38 


2.14 


1.65 


4 


H 


234 


2.92 


2.09 


1.41 


13 


I 


158 


2.06 


1.70 


1.51 


6 


J 


105 


3.05 


2.36 


2.08 


4 


Overall 


710 


2.38 


2.09 


1.64 


30 



a These numbers represent only fairly stable classes with reg- 
isters of ten or over. Classes with registers below ten were 
eliminated from this test. Thus, only 56 (of the total of 65 
second-grade classes) were tested. 
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Another "basic question can be asked concerning performance on 
a standardized test such as the MAT. How did the children per- 
form relative to grade norms? Table 2 indicates that a majority 
of classes scored below the grade norm of 2.7 for second graders 
at this stage of training. To check this point a count was made 
school-by-school of the number of classes exceeding the norm of 
2.7. The outcome details of this procedure are in Table 3, where 
it can be seen that very few classes in either the SPP group or 
the comparison group reached standard. Only eight of the total 
of 65 classes involved so achieved, four from the SPP schools and 
four from the control schools. Thus, underachievement on this 
test in these schools is the norm. 



TABLE 3 

NUMBER OF SECOND GRADE CLASSES REACHING OR EXCEEDING 
A GRADE EQUIVALENT OF 2.7 ON THE MAT IN FIVE 
SPECIAL PRIMARY PROGRAM SCHOOLS AND 
FIVE COMPARISON SCHOOLS a 



Special Primary 
Program Schools 


Comparison Schools 


A 


0/10 


F 


0/3 


B 


1/10 


G 


0/4 


C 


1/5 


H 


2/17 


D 


1/3 


I 


1/5 


E 


1/3 


J 


1/5 


All Schools 
Per Cent 


V 31 

12.9 




b/3k 

8.8 


Overall 
Per Cent 


8/65 b 

12.3 






St 

The denominator is the 


total number of 


classes 


involved. 



This total ( 65 ) differs from the total ( 56 ) indicated in 
Table 2 because low register classes with fewer than ten 
pupils were not eliminated from consideration here as 
they were in that table ( 2 ). 
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B. Turnover and MAT Performance 

Since environmental change has an established decremental ef- 
fect on any specific class of behavior, it was deemed important 
to check test performance against length of stay in school. A 
second-grade sample was available from School A that entered school 
in February 19&7 (W-l4), and another sample that entered in Sep- 
tember 1967 or later (W=l4) • Cutoff scores at a grade eq ui valent 
of 2.8 or higher and 1.2 and lower were selected as representing 
high and low achievement. The two-by-two sort is shown in the 
upper portion of Table 4. The intensity of association between 
date of entry and achievement is reflected in a phi coefficient of 
•39? significant for this size sample at the .02 level. The trend 
is clear: early entry coupled with stability generates higher 

achievement. 

The bottom portion of Table 4 presents the same sort of anal- 
ysis ior a fifth grade at School H. Here the W*s are substantial 
and while the degree of covariation is less, the trend is the 
same. Again, longer stay in the same school is associated with 
a higher level of test achievement. 

The effects demonstrated in Table 4 are not of large magnitude. 
Nonetheless they warrant consideration and further support the 
contention that a stable sample is required to reflect the effects 
of programmatic treatment. It is demonstrably meaningless to con- 
join children with a long duration of exposure to a program with 
those of brief exposure. Investigators must consider this source 
of variation in sample selection. 
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TABLE k 



THE PROBLEM OF PUPIL TURNOVER: LENGTH OF PUPILS* SCHOOL 

ATTENDANCE AND MAT PERFORMANCE IN TWO SCHOOLS 8, 





SECOND 


GRADE SCHOOL A 








MAT GE b 
Greater Than 
2.8 


MAT GE 
Less Than 
1.2 


Total 




Entered School 
February 1967 


12 


2 


Ik 


<t> = .39 


Entered School 
September 1967 
or Later 


7 


7 


Ik 


p = .02 


Total 


19 


9 


28 






FIFTH GRADE SCHOOL H 








MAT GE 
Greater Than 
Mean 


MAT GE 
Less Than 
Mean 


Total 




Entered School 
1967-1968 


17 (19. 0$) 


69 (80.2$) 


86 


f = .21 


Entered School 
1962-1967 


36 (38.7%) 


57 (61.3W 


93 


p = .002 


Total 


53 


126 


179 





& Entries represent number of pupils. 



v 

GE = Grade Equivalent. 



C. The Gates-MacGinitie Reading Tests in the First Grade 

The available findings for the first grade are summarized in 
Table 5 for the five SPP schools and five paired schools which were 
deemed comparable in geographic location and ethnic composition. 

Raw scores are shown separately for vocabulary and comprehension 
and are presented with grade equivalents on the last line of each 
section of the table. 
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TABLE 5 



GATES -MA.CGINITIE HEADING TEST SCORES IN THE FIRST GRADE 
IN THE FIVE SPECIAL PRIMARY PROGRAM SCHOOLS 
AND FIVE COMPARISON SCHOOLS 







FIVE SPECIAL PRIMARY PROGRAM 


SCHOOLS 








Vocabulary 


Comprehension 


School No, 


Median 


Range 


Median 


Range 


A 


256 


13.9 


0-46 


10.0 


0-32 


B 


132 


26.5 


8-46 


18.4 


0-34- 


C 


122 


29.2 


6-48 


15.2 


2-34 


D 


90 


15.5 


2-48 


9.4 


0-30 


E 


78 


18.8 


4-48 


11.7 


0-28 


Overall 










0-34- 


Raw Score 678 


18.6 


0-48 


12.0 


Overall Grade 










Equivalent 




1.2-3.4 


1.47 


1.2-3.6 


Scores 


678 


1.38 







FIVE COMPARISON SCHOOLS 






G 


91 


25.4 


6 - 1)6 


13.2 


2-32 


K 


147 


18.6 


0-46 


11.6 


0-32 


L 


303 


21.9 


4-48 


12.9 


0-32 


M 


136 


28.7 


8-48 


13.6 


2-32 


N 


156 


21.0 


2-48 


11.9 


0-32 


Overall 






0-48 






Raw Score 833 


23.1 


12.5 


0-32 


Overall 


Grade 










Equivalent 




1 . 2-3.4 


1.49 


1 . 2 - 3.6 


Scores 


833 


1.50 



Inspection of this table clearly indicates an appreciable 
spread in scores from school to school -with little systematic dif- 
ference emerging across the SPP and comparison schools. Both 
“count" statistics, and the more traditional modes of analysis 
yield only one significant difference, namely, differences across 
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the ten schools. This datum is, of course, expected. While the 
vocabulary scores on the average favor the comparison schools, it 

should be noted that two of the three highest scores were in the 
SPP schools . 



Again, a traditional instrument focusing on the acquisition 
and demonstration of specific skills failed to indicate incremental 
effects associated with the Special Primary Program. 

A more sensitive index of performance would clearly be per- 
centage change from a pre- to a post-measure. Far from complete 
information was available on the former, so a detailed analysis 
of gam scores could not be conducted. 



To determine level of performance relative to test norms, the 
pupils of the first-grade classes of the five SPP schools were 
classified according to the grade equivalent achieved: at l.Q or 
below, and above 1.9 for both measures. Only 25 or 4.2 per cent 

!u° r fim a grade equivalent of 2 -° or higher. As in the case of 
e MAT, performance was consistently below normative grade level. 

Essentially, the same picture emerges for the students of the 
ive comparison schools in both vocabulary and comprehension. 



D * The Gates -MacGinitie Reading Tests in the Second Grade 

Only grade equivalent scores for the five SPP schools were 
avaiiabie . These are contained in Table 6. There are appreciable 
dl “ erences across schools, but these were not statistically sig- 
nificant because of the great within- and across -school variability < 
for instance, the largest difference in school performance, 1.48 
versus 2.16 for vocabulary, must be considered in the setting of 
th e total variably, namely, 1.2 to 5.2. In passing, it might 
be noted that there is no reason to believe the picture would be 
changed by the inclusion of comparison schools, from which the re- ■ 
suits were not available. 
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TABLE 6 

GATES -MACGINITIE READING TEST GRADE EQUIVALENT SCORES IN THE 
SECOND GRADE FOR THE FIVE SPECIAL PRIMARY PROGRAM SCHOOLS 

Vocabulary Comprehension 



School No. Median Range Median Range 



A 


236 


1.48 


1,2-5 .0 


1.53 


1. 2-5.0 


B 


160 


2.09 


1.2-5. 2 


1.83 


1. 2-5.0 


C 


l4l 


2.16 


1. 2-5.2 


2.14 


1.2-5 .4 


D 


87 


I .69 


1. 2-5.2 


1.74 


1.2-5 .4 


E 


82 


1.66 


1.2-4 .8 


1.65 


1.2-5 .4 


Overall 


706 


1.82 


1. 2-5.2 


1.78 


1.2-5 .4 



As in the first grade, the achievement of 678 children was 
sorted as exceeding or not exceeding a grade equivalent of 2.9« 

This indicates that 109 of the 678 pupils whose records could be 
used in the final analysis of the data attained a grade equiva- 
lent of 3-0 or higher. This figure represents 16.2 per cent. 

. As in the other test instances, gain scores from earlier to 
later testing would have generated a more complete picture, but 
the earlier test information was not readily available in complete 
form. 

E. The New York Child Development Scales in Grades Pre-K Through 
Two 

The point has been previously emphasized that an intervention 
program can follow one of two courses: building in specific skills 
in reaction to specific stimulus materials or maximizing general- 
ization or transfer. There is obviously no reason a program can- 
not do both, and this is the course of choice. The New York Child 
Development Scales (CDS) offer a first step toward a measure of 
transfer. They constitute essentially check lists covering the 
child's ability to take care of himself and to get along with chil- 
dren and adults, his capacity for communication, and sensorimotor 
skills. The teacher, after considerable observation of the child, 
executes these scales for three levels — at the child's age, one 
year younger, and one year older. 
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The original evaluation plan called for execution of the CDS 
on two classes of approximately 15 children each, at each of the 
four grade levels. Each child was to be rated by two independent 
teachers in each of the five SPP schools, and one comparison 
school. Because of time and personnel limitations along with 
other considerations, this plan could not be implemented. Thus, 
only incomplete information was available . It is , however , basic 
to present it since it is the first small step toward determining 
the extent to which the intervention program ingrains habits that 
carry over to various activities beyond the academic situation. 

For instance, one might determine the frequency and intensity 
with which a child seeks out reading material on his own outside 
of the school situation. 

The incomplete returns from this instrument are contained in 
Table 7. First, it should be noted that there was extremely wide 
variation in exactness of execution of the scales. Across the 
board, less than 50 per cent of the returned scales were usable 
because of variations evident in teacher interpretation of in- 
structions. Next, those that were usable showed enormous vari- 
ability from rater to rater. For instance, in Table 7> one sample 
in the first grade shows a median of 39 of a possible 60 points, 
with a range from 5 to 57 > while another sample in a different 
school has a median of 60, with no spread whatsoever. Such numer- 
ical characteristics, of course, prohibit statistical treatment 
of the data. Within the gross limitations of the data,, the main 
finding is the great individual variability. 
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TABLE 7 

NEW YORK CHILD DEVELOPMENT SCALE TOTAL SCORES IN 
SELEC TED CLASSES IN THE FIVE SPECIAL PRIMARY 
PROGRAM SCHOOLS AND ONE COMPARISON SCHOOL a 



School 




Pre K 


K 


1 


2 




Number 


8 


10 


9 




A 


Median 


36 


40 


53 






Range 


16-46 


18-57 


13-57 






Number 


19 


12 




24 


B 


Median 


59 


59 


— 


37 




Range 


29-60 


45-60 




7-57 




Number 


7 


15 


4 




C 


Median 


59 


52 


60 


— — 




Range 


46-60 


21-59 


0 






Number 




19 


31 


20 


D 


Median 




47 


39 


54 




Range 




14-60 


5-57 


38-59 




Humber 


10 


15 


15 


6 


E 


Median 


36 


48 


33 


50 




Range 


19-50 


16-57 


25-54 


18-60 




Number 






32 


12 


H* 


Median 




mm mu mm 


58 


58 




Range 






23-60 


46-60 



®H indicates school used as comparison. 



The main point of this section is to indicate the direction 
that assessment procedures should take with regard to the matter 
of generalization and transfer of the habits acquired in the 
school setting to nonacademic situations. Clearly, considerable 
research emphasis has to be given to instrument development and 
tryout. The first order of business in this regard must involve 
a thorough examination, a kind of job analysis, of the nature of 
the child* s activities outside the classroom that might be sensi- 
tive to and reflect transfer of skills and habits acquired in the 
classroom. It may well be that this area is the most significant/ 
one for future research dealing with intervention programs in 
early education and training. 
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CHAPTER IV 

FINDINGS : OBSERVATIONS, INTERVIEWS, AND QUESTIONNAIRES 



A. The Evaluation Procedure 

The administrative policies that characterized the schools in 
the study varied so that it became difficult to measure the schools 
against each other. The educational philosophy and the attitudes 
of the administrative staff to a large extent determined the atmo- 
sphere in each school. Whether the classroom ambience was well 
structured or over structured, how disciplinary problems were 
handled, to what extent parental and community involvement were 
sought — all these had an effect on teaching, morale, and atti- 
tudes • 

To obtain an overview of each school and what the SPP meant 
to it, the program was examined from several points of view, which 
are discussed in the following sections. 

B. Report of Interviews with Principals 

In addition to the increased staff and facilities allotted to 
the Program to Strengthen Early Childhood Education in Special 
Service Schools, the Special Primary Program in Five Schools was 
intended "to incorporate the best features of existing programs, 
such as MES andADNS, into one coordinated, enriched, unified pro- 
gram." The program in the five schools extended from K to sixth 
grade, but since a good part of the extra personnel had been 
allotted to the early childhood grades (e.g., extra teachers to 
maintain a l-to-15 pupil-teacher ratio in kindergarten grades, and 
an additional assistant principal in each school), the evaluation 
team thought it best to concentrate its efforts on the lower pri- 
mary grades of each school. The principals and their administrative 
staffs were interviewed to find out how much of the plan was being 
carried out, before independent observations of the program in 
action were made. They were interviewed again during the evalua- 
*tion to assess their reactions to this pilot program (SPP) within 
a program (Program to Strengthen Early Childhood Education in Spe- 
cial Service Schools). 

1. Implementation of the program . Budget requirements were 
met with one or two exceptions . Except for those positions for 
which there is a special license, such as assistant principal and 
guidance counselor, the principals chose their specialist staffs 
from among the ranks of their teachers. Grade coordinators and 
language-art coordinators seemed to present no particular problem, 
but the position of the community relations coordinator did, in 
at least two of the schools. In these two schools, principals felt 
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that these positions should be filled by members of the community 
rather than by being drawn from the faculty. When qualified per- 
sonnel were found in the community, they were commanding a higher 
salary than could be offered them in the schools. So the positions 
went unfilled. 

None of the schools had a full clinical team of a social work- 
er, psychologist, and psychiatrist. Where a social worker was 
assigned, he was not usually assigned for the number of days 
allowed in the budget. Toward the end of the year, one school had 
had the services of a psychiatrist for a few hours. Psychologists 
were not available at all. 

2. Selection of personnel . With the appointment of an addi- 
tional assistant principal, the burdens of administrative detail 
were in larg aeasure removed from the principal’s responsibility, 
and he felt freer to devote himself to the training and observa- 
tion of teachers and to developing new policies for the school. 

The grade coordinator served a key function in teacher train- 
ing and curricular administration, and was therefore vital to each 
grade. Budgetary limitations were basic to some problems encoun- 
tered in assignments of SPP coordinators. Coordinators for grades 
one and two were budgeted from the strengthened Early Childhood 
Program — technically, the SPP budget provided for grade three 
and four coordinators only. Thus, most SPP schools assigned the 
assistant to principal as grade coordinator for pre-K and kinder- 
garten. There was some reservation on the part of teachers in 
accepting a supervisor (the assistant to principal is considered 
part of administration rather than of staff) in the role of coor- 
dinator. The strength of the grade coordinator’s role lay in his 
relation to the staff as a peer, with time and ability to give 
demonstration lessons, to help in the planning and coordinating 
of lessons, and to lead teacher- training sessions, but without the 
need to supervise or rate the teachers with whom he worked. 

While certain factors such as the ethnic imbalance and the de- 
prived population were qualities common to all the five schools, 
their staff deployment varied greatly according to their super- 
visory philosophy and delineation of teaching roles. 

While some schools appointed their extra staff with discrimi- 
nation, others appointed teachers to special positions as a reward 
for years of service rather than for qualities of pleader ship and 
initiative. The teachers’ roles were defined differently in the 
schools. In some instances the language-arts coordinator spent the 
time teaching in as many classes as could be covered; in others, 
this person acted as coordinator, defining and explicating to the 
staff what was to be taught to the pupils. In some schools, the 
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grade coordinator was occupied with details of scheduling meetings, 
checking plan hooks, and preventing teacher conflicts; in others, 
this person took on the vital role of teacher trainer . 

3. Attitudes of the principals toward the program * Questions 
to principals about so-called "team teaching" brought varied re- 
sponse, Since the Strengthened Early Childhood Program and the 
SPP were both predicated upon a reduction in pupil-teacher ratio, 
it became necessary, in instances of space shortage, to assign two 
primary teachers to one classroom. Each teacher in grade one had 
her own register of 15 pupils and, in grade two, 20 pupils. This 
accommodation of two teachers within one classroom brought to the 
fore many problems related to team teaching. The two-teacher 
classroom was recognized by all to be an expedient made necessary 
by lack of space. The difficulties in such an arrangement were 
many. There were teacher personality conflicts and disagreements 
about housekeeping habits and the disciplining of the children. 

In addition, both teachers and children found it distracting to 
hear two voices and two lessons going on at the same time. On 
the other hand, the class units were so flexible that it was possi- 
ble for one teacher to take a few children for special or remedial 
work, while the other conducted a lesson for the rest of the class, 
Where the teachers really worked together well, both teachers and 
principals spoke with genuine enthusiasm about the fluidity of the 
tea ch ing situation. Both groups, however, would have preferred 
separate classrooms for the conduct of such an experiment. 

One of the bonuses of the Special Primary Program was the 
extra personnel it provided for the kindergarten classes. This 
made it possible to increase the session for pre-K and K children 
from two and one -half hours to three. The principals felt that, 
for the children involved, this was a true head start. But while 
no principal would turn down the offer of additional personnel, 
many implied that the presence of four adults — two teachers and 
two aides — in a class of 15 was often more cumbersome than effi- 
cent. 

The consensus was that there were two special increments in- 
volved in the Special Primary Program over and above the extra 
services offered by the Strengthened Early Childhood Program. 

One was the addition of personnel to make possible an expanded 
kindergarten program. The other was the provision made for an 
extra grade coordinator in each of the five schools, a role con- 
sidered to be crucial to teacher training. According to the 
principals, the colleges did not adequately prepare students for 
teaching in disadvantaged areas, and teachers have had to cope 
with these difficult situations by themselves. In one school the 
average experience of the faculty was one year and eight months. 
The most practical and efficacious solution was considered to be 
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on-the-job training, and principals regarded the grade coordina- 
tor as the prime teacher trainer. 

There was less consensus about the value of the After School 
Study Center (ASSC), a two-hour extension of the schoolday con- 
sisting of clubs and remedial activities. Some principals felt 
that, for young children, a lengthened schoolday was more exhaust- 
ing than stimulating. Others were certain that the benefits far 
outweighed the disadvantages. About one-quarter of the schools* 
population attended the ASSC. One could not be sure whether atten- 
dance was urged by the schools, encouraged or forced by the parents, 
or accepted by the children for reasons of their own. Details of 
the ASSC will be discussed later. 

Most principals saw true parent involvement as a long-term 
rather than an immediately realizable goal. They felt that it 
was too soon to evaluate a process that required much time and 
effort on the part of both school personnel and parents to effect 
actual engagement of parents in the learning program. Accordingly, 
most principals felt frustrated by apparent lack of success to 

date in achieving the kind of pp' nt involvement they hoped for 
ultimately. 

^ • Principals suggestions . Only those suggestions concurred 
in by a majority of the principals are incorporated here. 

a. Each principal would have wanted more contact with 
the other schools in this pilot program for an exchange of ideas 
concerning principles and practices and for the consideration of 
successes or failures . Only two meetings for these exchanges 
were held during the year. 

b. VThile refreshments were provided for ASSC students, 

no provision was made to compensate the custodial staff for clean- 
ing up. The school either made its own provisions or eli mi nated 
a refreshment period. This situation should be remedied. 

c. The addition of so much nonteaching personnel created 
confusion within the school, as well as bookkeeping problems. 

Special help should be provided in the handling of their payro lls . 

d. Team teaching could not be fairly evaluated at this 
time because of space limitations. It was extremely difficult for 
two teachers, even if they were working harmoniously, to function 
in the same small classroom meant originally for only one teacher 
and her class. Two voices were distracting to the children. Dif- 
ferent teaching personalities created different demands on the 
children, causing conflict. Separate classrooms should be provided 
for the effective implementation of this program. 
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e. Since appropriated funds for the clinical team were not 
used because team personnel were unavailable, it would be more prac- 
ticable for each school to engage a psychiatrist or psychologist on 
a per-session basis. Many of these professionals, while they are un 
willing to tie themselves down for a given number of hours per week, 

would be willing to see children as needed if they were adequately 
recompensed. 



While there were many criticisms and other suggestions , on the 
whole, any program which made lower registers possible, and encour- 
aged experimentation, was welcomed. It was too early to tell at 
the time of the interviews whether achievement tests in reading and 
arithmetic showed any dramatic improvement as a result of the lower 
registers, but other improvements (in social behavior and emotional 
stability) were noted by the staff. 

C. Parent Involvement 



The five schools had had prior difficulty in getting genuine 
parents’ movements going. Parents, according to staff reports, 
responded directly to the needs of their own children, not to the 
broader social needs of the school or the community. A parent 

more likely to attend a meeting where his child was perform- 
ing, or where his child’s specific problem would be discussed. 

In four of the five schools the administration found no adequate 
method of involving parents in large numbers, other than inviting 
them to meetings where they might see their children perform, or 
to parent- teacher grade meetings which took up specific subject- 
matter problems in their children’s partic ular grade. 

The fifth school had somewhat more success because, at the out- 
set, they had involved the community. In this school the adminis- 
trative staff met regularly with a steering committee (an offshoot 
of the local Community Council) consisting of representatives of 
parents, teachers, college professors whose training center fed the 
new teachers to the staff, small businessmen, civil rights organi- 
zations, community action people, etc. At these meetings, the 
community representatives were informed of what was going on in the 
school, and the school kept in touch with what was going on in the 
neighborhood. The general school problems became matters for con- 
cern in the community. As a result, the school had a large pool of 
volunteers to draw on, and a more relevant response to general 
problems. 

A selected group of 45 parents (about nine parents in each of 
the five SPP schools) was questioned concerning their involvement 
with the school's program, and with the school, in relation to their 
own children. These parents to whom the questionnaires were addres- 
sed, were not a representative sample of the parent population. 
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since they were either working in the school as aides, had attended 

The°Darents T 1133 ° h ^ laren attendin S the After School Study Center. 

tp wnom l he questionnaires were distributed were al- 
ready involved m school participation, and could therefore be rea- 
sonably expected to answer after careful consideration. 

school ^ e !l 45 pare “ts questioned, 77 per cent were working in the 
least oncA Tv ° apaclt J’ 53 per cent volunteered their services at 

children in thJTchoT* iT* atterlded workshops, and 43 per cent had 
Center th h 1 who were att ending the After School Study 

lishw ?T Stl0n f fo ? usei around the role the parent in estab- 
d maintaining homework routines and study habits for 

task TdThf 1 ’ ! he iT le ° f the sch001 in hewing parents with this 

school was effSive “ lialS ° n betWeen palent and teacher 

Of these parents , 81 per cent said they provided a given time 

cent P checked^That could do his homework. Seventy-one per 

“a, “ “ d . tha t the homework assignments were carried out, 

effect w _? ent actually helped the child with his homework, in 
effect helping to teach him or reinforcing what he had learned. 

w^reTrt^T ° f i^ he parents thought that the homework assignments 
rtitf-i de J mte > that is, neither too much nor too little, nor too 

itTutt^ “° r t0 e ® aSy ‘ Almost two-thirds of the parents thought 
tn 2^T Pr ° P !5 fo 5 parents to be asked to help teach the child ; 

-..hl t LTT* ? hat the teaching of reading and arithmetic 
(subject matter) should not be left entirely to the teac her . 

. A11 fave sch ools conducted workshops for parents, with varying 

degrees of success. The workshops discussed such topics as 
ng methods, new math, child guidance, and problems of early child - 

af^iw eS VTT deSi ? ned tC help the parent assist aad understand 
the child. Workshops in English for non-English-speaking parents 

sewing nutrition and crafts were designedlo help the p^r^t he^ 

Mints' ■ workshp P s > ^ was hoped, would bring the 

aTaTTT 0 T SC ?T 1 situat ion, and indeed these were better 
attended than the others. Later the parents would be drawn into 

& cussiaiis °°“ c ? r ? ln S other problem areas. About half the respon- 
dents attended at least one of these workshops. Although they 

^ pr ®?. ch001 children during the day to be cared for 
by a family worker while they attended the workshops, only a few of 
them could find time to come with any degree of regularity. 

. . !° rt 5 r ;! hree per cent of the respondents had children who atten- 
ded the After School Study Center. More than half of them or 58 

per cent, said that the Center had helped their children very much 
Their suggestions for improvement included greater involvement of 
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parents and/or paraprofessionals in the reading program, better 
articulation between the day school and the ASSC, more adequate 
instruction to parents in homework supervision, greater stress 
on phonics and reading, and increased involvement of the commu- 
nity at large. 

The profile of an ideally involved parent (of whom there were 
relatively few) would show that she was interested in what the 
child was studying at school, in his reading progress, and in his 
homework habits. She would provide a specified time and place 
where the child could do his work, would check on what he did, and 
would often help him out with his learning problems. In order to 
keep abreast, she would be in fairly frequent contact with the 
teacher and the school, would occasionally volunteer her services, 
and would, if she could, attend workshops on subjects which would 
help her to help her child. 

D. Community Involvement 

One of the major goals of the Special Primary Program was to 
involve the community in the total program. While a concerted 
effort was made at all schools to implement this objective, the 
goal was not achieved over and beyond the data reported regarding 
parental involvement in the program. Only one school was success- 
ful in this regard. In this school a board of advisors from the 
community, as previously noted, was continuously consulted and 
actively participated in the development of the total school pro- 
gram. It is difficult to measure the community contribution in 
terms of the Special Primary Program, since it was directed toward 
the total efforts of the school. 

The difficulties encountered by the other schools were report- 
ed in various ways . They seemed to take two forms : active resis- 

tance and passive apathy. Community persons were either "too 
busy" or too disinterested or, possibly, too timid to engage them- 
selves in the various school programs. 

While these comments cannot be supported quantitatively and 
are thus interpretative and possibly premature, it would seem 
basic to consider ways of engaging community groups and members 
in the overall school program on some sort of partnership basis. 

E. Teachers 1 Perceptions of the Special Primary Program 

1, The evaluation procedure . For the purpose of determining 
how the teachers felt about the services given to their schools as 
part of the Special Primary Program, a two-part questionnaire was 
distributed. The first part dealt with the After School Study 
Center and its influence on student achievements and attitudes in 
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the day school. The second dealt with teacher attitudes toward 
other features of the program, such as the smaller registers, 
the two-teacher classroom, and the need for further training. 

In the Special Primary Program, with the exception of one 
school, only those students in grade two and above were permitted 
to attend the ASSC. Those below grade two were thought to be too 
young and immature to benefit from an extended school day. Only 
the second-grade teachers in each school (36 in all), therefore, 
were asked their reaction to the ASSC as they perceived it in re- 
lation to those of their students who attended. The questions 
were designed to elicit teacher reaction to several categories: 
actual improvement in reading or study skills; increased interest 
in reading or other subjects; attitudinal changes of the child to- 
ward his peers, toward his teacher, and toward school in general. 

2. Actual improvement in reading or study skills . About one- 
third of the teachers reported that every one of their students 
who attended the After School Study Center showed marked improve- 
ment in carrying out homework and extra assignments. An additional 
32 per cent said that more than half their students showed similar 
gains. About 30 per cent said there was no appreciable difference. 

As for specific reading skills, the majority of teachers felt 
that most of the students displayed a better grasp of phonics, 
reading comprehension, and study skills or specific work habits. 
Also, most of the teachers said that their children (more than 
half of those attending ASSC) were showing greater interest in 
reading by seeking books either in or outside the classroom which 
they were not required to read. This index might well turn out to 
be a basic measure of the effectiveness of a program such as SPP. 

About 75 per cent of the teachers observed an improvement in 
students* attitudes toward each other and also in their relation- 
ships to the teacher. But very few of them could point to any 
specific attitudinal change. (Only 21 per cent documented their 
answers wioh specific examples.) 

3. Teachers* needs . In the second part of the questionnaire, 
teachers were asked how they felt about smaLl groups and how to 
handle them, about the presence of another teacher in the classroom, 
and about the areas in which they felt they needed further training. 
The mean number of years of experience for these teachers was 4.3 
years of total experience and 3.6 years in their present school. 
These means were brought up, however, by the presence of a very few 
teachers who had been working for a much longer time. In two 
schools the mean of experience was only 1.8, and in a third school 
2.8 years. Those teachers with the least experience welcomed most 
the presence of smother teacher in the classroom and expressed in 
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more exact terms their need for further training in specific meth- 
ods as well as in special methods found effective in teaching dis- 
advantaged children. 

Two-thirds of the teachers were not bothered by the presence 
of another teacher in their room. Nevertheless, while they recog- 
nized the flexibility made possible by another teacher in the 
classroom, 86 per cent of them would have preferred to have a 
class of 15 in their own classroom rather than a total group of 
30 shared by two teachers. 

The majority of teachers (82 per cent) reported that they had 
found new techniques for handling small groups . When asked to 
specify what these techniques were, most of them described the 
use of individual flash cards and individual reading, made possi- 
ble by the presence of another adult in the room (either teacher 
or aide). Ability grouping, fluid seating arrangements, and 
attention to individual personal problems were also mentioned as 
techniques made possible by the presence of another teacher, as 
well as by small groups. 

Almost all (94 per cent) said they needed further training 
for work in disadvantaged areas. Requests for training fell into 
three categories: specific teaching methods, for example in read- 

ing and math; techniques for handling small groups; how to handle 
discipline problems; and how to identify and work with emotionally 
disturbed children. These needs might be met in part by: more 

frequent presentation of demonstration lessons; closer liaison 
with a non-rating advisor, such as a grade coordinator, to whom 
they could turn without fear of displaying weakness ; and access 
to psychological and psychiatric consultation. In other words, . 
they were really asking for more on-the-job training, since their 
college courses had not prepared them for what they had to meet. 

4. Evaluation of teacher performance . The Individual Lesson 
Observation Report (ILOR) was an instrument first used in the 
1966-67 evaluation of the Free Choice Open Enrollment Program, 
and also used in the evaluation of the Expansion of the More Effec- 
tive Schools Program. To quote the MES report, "The data . • . 
suggest that the ILOR produces reliable ratings of the phenomena 
being observed, despite the lack of any definitions of gradations 



4* ox, David J. Expansion of the Free Choice Open Enrollment 
Program (New York: Center for Urban Education, September 19&7 ) • 

^ox, David J. Expansion of the More Effective Schools Pro- 
gram (New York: Center for Urban Education, September 1967)* 



ERIC 



31 



of quality ... As to validity, the ILOR can only be defined in 
terms of the validity of the content.” Nevertheless, since it is 
a tool which was used by over 70 observers in previous studies, 
the inclusion of it in the present study might ease the way for 
future comparisons . 

The phenomena being investigated were the possible effects of 
lower class registers on both the teaching process and the learn- 
ing process. With this in mind, the evaluation team looked for 
evidence of the teacher’s planning, the amount of material covered, 
the quality and depth of instruction, and the adequate utilization 
of the small register. In respect to the children, the team wanted 
to see how they responded in the classroom situation, whether they 
were able to bring outside experience to bear in the learning pro- 
cess, and whether they could raise spontaneous questions of their 
own which would show that they were learning to learn. 

In each school at least one class in each grade (Pre K to 2) 
was observed, and in several schools more than one class was seen 
in each of these grades, a total of 28 class observations, repre- 
senting about one-fourth of all the classes (22 per cent) at these 
grade levels in the five SPP day schools. 

F. Findings 

1. Aspects of teacher functioning . In about half of the 28 
classrooms visited there appeared to be a we 11 organized and well 
planned lesson in progress. These lessons, in a majority of the 
cases, appeared to be ’typical of normal classroom activity. Al- 
though the observers were expected in the school, the specific 
classes to be visited were chosen by the observing team after 
arrival at the school. In another 25 per cent of the classes, it 
was obvious that some plan was being followed, but there was no 
evidence of exceptionally good planning. In about 22 per cent of 
the classes there was some organization and some previous planning, 
but perhaps a better word to use would be scheduling. Reading, 
for example, was taken up at a given time, and certain materials 
were used. Whether the techniques or methods used were built in- 
to the plan was not clear. 

The overall quality of the lesson was judged by the amount of 
material covered , the depth of instruction, the effective use of 
teaching aids, and the creativity or ingenuity of the teacher in 
developing new materials where- inadequate ones existed, ihe in- 
genuity of the teacher was judged, in addition to the above men- 
tioned aspects , by her ability uo adapt her teaching techniques 
to small class registers. 



In general, the majority of the teachers observed were of aver- 
age overall ability or above, despite the frequent lack of experi- 
ence, as indicated by the following figures (based on 36 teachers 
in grade two): 



TABLE 8 



YEARS OF EXPERIENCE OF 36 SECOND GRADE 
TEACHERS (SPP) 



Years of Experience 


Per Cent 


10 - 20 


13 


5 - 9 


14 


3-4 


20 


0-2 


53 



Although these principals deplored the lack of proper training of 
teachers for work in disadvantaged areas, they suggested that 
possibly the teachers licensed in Early Childhood were better 
trained than the others . 

Half the teachers (50 per cent) covered an adequate amount of 
material during the lesson observed, with about 35 per cent doing 
better than average, and 15 per cent doing less well. In judging 
depth of instructional material, the proportions shifted somewhat, 
with only about one-third doing a passable or average job, and one- 
third performing on an inferior level or below. The percentage of 
above average or superior performances in this aspect remained more 
or less the same (33 per cent). The same proportion obtained where 
the effective use of teaching aids was judged. These and the fol- 
lowing details are shown in Table 9* 

In the area of creativity (ingenuity) there were about one- 
third of the teachers in the above average range (although only 
seven per cent were rated as superior or outstanding). About 25 
per cent were noted lacking in this quality. 

In 6l per cent of the classes it was noted that the effective- 
ness of the lesson would have been seriously diminished, or rendered 
useless by the existence of larger classes. One of the reasons for 
this large proportion perhaps is that in the two-teacher classroom, 
of which there were many, one of the teachers was frequently able 
to take just a few children aside to work with them in the areas 
of their weakness, a situation which would have been impossible to 
initiate in the ordinary single teacher classroom. 



TABLE 9 



RATINGS OF ASPECTS OF TEACHER FUNCTIONING 81 FOR ALL FIVE 
SPECIAL PRIMARY PROGRAM SCHOOLS 
(N = 28 CLASSES) 



Aspect 


1o 

Above 

Average 


oL 

fO 

Average 


i 

Below 

Average 


Quality of lesson 


54 


36 


7 


Amount of material covered 


35 


50 


15 


Depth of lesson 


33 


33 


33 


Planning and organization 


50 


25 


22 


Creativity and imagination 


35 


36 


25 


Use of teaching aids 


33 


33 


33 


Utilization of smaller 
registers 


6l 


18 


21 


Warmth of teacher -pupil 
relationship 


94 


3 


3 



Sphere the percentages do not total to 100, it is because, in 
some classes, the rating of the particular aspect was not rele 
vant . 



2 . Aspects of children's functioning . Above all, the neces- 
sary ingredient for effective teaching, whether or not it was 
accompanied by experience, was the warm and giving attitude of the 
teacher toward the class. Where this quality existed - in over 
70 per cent of the classrooms^ - the children seemed to be more re- 
sponsive to the learning process. On the whole, though, while the 
children (86 per cent) seemed interested or very interested in the 
lesson being presented to them, in only 53 per cent of the classes 
did the children volunteer in response to the questions asked them. 
In a very small percentage of classes (15 per cent) did any of the 



^ The discrepancy between this 70 per cent and the 94 per cent 
of the teachers* listed in Table 9 is that in some instances there 
were two teachers in the classroom. 
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children raise spontaneous questions. The details are presented 
in Table 10. 



TA.BLE 10 

RATINGS OF ASPECTS OF CHILDREN'S FUNCTIONING 9, IN FIVE 
SPECIAL PRIMARY PROGRAM SCHOOLS 
(N = 28 CLASSES) 



Aspect 


of 

Above 

Average 


* 

Average 


of 

/0 

Belov/ 

Average 


Overall participation of 
children 


82 


11 


4 


Positive overall teacher- 
pupil relationship 


71 


4 


4 


Display of children’s 
interest 


50 


36 


14 


Children’s spontaneous 
questions 


11 


4 


64 


Volunteering in response 
to questions asked 


4-2 


11 


18 


Use of child’s background 


25 


4o 


32 



a Where the percentages do not total to 100 , it is because, in 
some classes, the rating of the particular aspect was not rele- 
vant. 



In about two-thirds of the classes (65 per cent) an effort was 
made to bring in the experience of the child, or relate the material 
to his background. Only 25 per cent of the teachers were able to 
use this technique effectively; one-third of them made no such at- 
tempt in the lessons observed. 

3 . The After School Study Center . The After School Study 
Center (ASSC) was built into the SPP as an extension of the school- 
day for those children wishing to remain. It was conducted from 
three to five o’clock on three days a week. Its organization was 
flexible with the intent of improving achievement and making school 
more meaningful. Most principals chose to conduct a program including 
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both remedial classes and clubs. All participants remained for 
the entire afternoon. 

Information about the After School Study (ASSC) was gathered 
in several ways: by interviews with the principals and their ad- 

ministrative staffs — to determine the organization plan, enroll- 
ment, and teacher allotment; by interviews with teachers; and by 
direct observation of the classes. Also included in the data is 
some feedback material from teacher and parent questionnaires. 

a. fhe staff . The size of the staff was increased from 
seven to a maximum of 20 for each ASSC in the Special Primary Pro- 
gram. All registration was voluntary. A pupil-teacher ratio of 

1 to 15 was the goal. Enrollment varied in the different schools 
(l4 per cent to 40 per cent) with about 1,100 participating, out 
of 2,336 in the five schools. Those who attended with any degree 
of regularity comprised only 30 per cent to 67 per cent of those 
enrolled. Thus, of the register of approximately 1,100 in the 'ASSC 
of the five schools, only 54 per cent really attended, or only 23 
per cent of the total school populations. Therefore, instead of 
having a pupil -teacher ratio of 1 to 15, the ratio was more likely 
to average 1 to 8. 

In each school the principal was designated as the coordinator 
of the ASSC, and there was an assistant principal in charge of 
supervision. The atmosphere in the ASSC tended to reflect the 
attitude of the principal toward it: where he felt the activity 

did not serve a useful purpose, the teachers tended to be lacka- 
daisical; where the principal believed the ASSC was a positive 
factor, the teachers worked vigorously and imaginatively. 

There was no difficulty in staffing the ASSC because, for the 
teachers, extra money was involved. In fact, there was a scramble 
for these positions and often two teachers shared a class of ten. 

b. A ssessment of the ASSC Program . As the five SPP schools 

varied in their day to day functions, so did. they differ in creat- 
ing tools for assessment of the ASSC program. As can be seen in 
Table 11, the spread was great: from no records of attendance and 

no other arrangements for reporting back, to periodic questionnaires 
sent to parents, teachers, and students, and to conferences between 
day school and ASSC teachers. The more valuable the program seemed 
to the principal and the administration, the more time and effort 
the school put into it. 
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TABLE 11 

FEATURES OF THE ASSC IN THE FIVE SPP SCHOOLS 



School 


Attendance 
4 of 

Enrollment 


Articulation Measures 


Admin . 
Expressed 
Opinion 


Quality of Teaching 


E 


30 


No plans; no attendance 
taken 


Negative 


Poor; time-serving 


B 


30 


Report card sent home at 
end of term 


Negative 


Uneven; poor to good 


C 


66 


Attendance taken; ques- 
tionnaire to be sent 
to parents 


Positive 


Structured teaching; 
carefully planned 
lesson 


D 


67 


Report to day school 
teachers; notation 
on child's record. 


Enthusi- 

astic 


Excellent planning; 
special classes 
formed 


A 


66 


Teacher, student, par- 
ent questionnaires; 
teacher consultations. 
Suggestions accepted 
from Parent -Community 
Steering Committee 


Enthus i- 
astic 


Imaginative, zeal- 
ous, uneven 



c. Reactions of teachers and parents . To judge from con- 
versations with teachers (there was at least one interview in 
depth in each ASSC), although some started out being skeptical 
about the favorable effects of a lengthened school day, by the 
end of the year most were convinced that the child's exposure to 
additional education had helped him. While some cited subject 
gains, that is, actual improvement beyond expectation in reading 
skills, others noted shifts in social attitudes which they con- 
sidered equally important. All felt that the intimate relation- 
ship between teacher and pupil , made possible by the low registers, 
was a major positive force. 

The teachers also spoke about the shortcomings of the ASSC. 
Since the registers were so small, it was frequently impossible 
to group the children according to grade, and all too often an 
after-school class was made up of children from grades two to six, 
thus compounding the difficulties of teaching. Also there was 
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not enough available material that was different from day school 
material, and this put an additional burden on a conscientious 
teacher. Finally, most of them felt that there was not enough 
central planning for the ASSC. In a sense, every teacher was on 
his own, and did what he wanted to do. 

d. Observations of the program at work . In order to ex- 
amine the functioning of the ASSC, visits were made to about one- 
third of the classrooms in the program. The observers sought to 
find out how the teachers perceived the program, to what extent 
they were able to create new techniques for small groups, what 
measure of success was being charted in effecting attitudinal 
changes as well as changes in subject areas. To this end an ob- 
servation guide was devised which would help organize impressions 
(ASSC Observation Guide, contained in Appendix B). After ascer- 
taining the facts (enrollment, attendance, nature of activity, 
lesson format), the guide focused attention on the teacher’s method 
of work, the planning of the lesson, the use of new materials or 
the teacher’s ingenuity in creating them, the development of new 
techniques for small groups , and how the teacher felt about the 
ASSC program. 

Observations about subject gains were essentially subjective, 
since no arrangements had been made in any of the schools to mea- 
sure concrete gains against comparable achievements in the day 
schools from which these children were drawn. The same could be 
said of the attitudinal changes observed by the teachers, which 
if they took place, did so gradually over a period of time and 
could not be noticed by an observer, on a single visit, unless 
called to his attention by the teacher. Reliance in both these 
matters had to be put on what the teachers said or thought they 
had achieved. On the other hand, whether the teacher had planned 
the lesson, whether adequate advantage was being taken of small 
class size, or whether ingenuity was exercised in the face of in- 
adequate materials was very evident to a trained observer. 

Table 12 summarizes information on teacher functioning in the 
ASSC. The subject matter covered in 45 per cent of the lessons 
was worthwhile; that is, enough material was covered during the 
period to support the extra time, money, and energy devoted to it. 
According to their own reports, 50 per cent of the teachers also 
managed to shape and modify the attitudes of the children in their 
charge: the children were less recalcitrant than they had been, 

and were assuming a more positive attitude toward school and 
accepted social values . This could perhaps be attributed to the 
large proportion of teachers (70 per cent) who were perceived by 
the observation team as being warm and giving, and who had estab- 
lished rapport with their small numbers of children. ("Rapport," 
it must be remembered, is another difficult thing to measure ob- 
jectively. The observers could only sense by the reaction of the 
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student to the teacher that he was accepted, understood, or chas 
tised with affection.) 



TABLE 12 

ASSESSMENT OF TEACHERS IN ASSC IN ALL FIVE SPP SCHOOLS 



Per Cent 
of Total 

N = 24 Classes Classes 



Activities carried out in the form of games or project . . 4l 

entirely through tutoring 25 

through formal lessons 34 

Organization and plan of Well planned 42 

activity of lesson Evidence of some planning 25 

No signs of planning 33 

Availability of materials 

different from those in Sufficient 50 

day school Insufficient 50 

Coverage of material: Yes 45 

Did it warrant the No 25 

extra time? Sometimes 30 

Ingenuity of teacher in Positive ^6 

face of shortages Negative 54 

Adaptation to small Complete 38 

registers In many or most instances 38 

None 24 

Development of new tech- Many new techniques 24 

niques for small Individual tutoring 38 

classes None 38 



Questions in the ASSC Observation Guide were also directed to 
the way the students reacted to the additional tutoring given them. 
As in the day schools, although children by and large volunteered 
answers to questions the teacher asked, very few of them raised 
any spontaneous questions on their own. They were willing to be 
taught, but were only passively learning. But unlike the day 
schools, the ASSC was looked forward to by the children because of 
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its atmosphere of extra curricular activity. Although most of the 
children were not resistant to the idea of a lengthened school day, 
the formal learning periods were considered by them to be the nec- 
essary prelude to the time of "fun and games" which most of the 
students anticipated with pleasure. Only a minority (12 per cent) 
resisted both types of activity. 

The single great advantage observed in the ASSC was the inti- 
mate contact it afforded between the teacher and the pupil. The 
fact that the classes were for the most part even smaller than had 
been anticipated made individual tutoring possible. Most teachers 
(75 per cent) cited individual tutoring as the source of improve- 
ment in subject matter. Indeed, more than one- third of them (38 
per cent) considered individual tutoring to be a new technique in 
the handling of small groups. Only a little more than one-third 
of the teachers had found other different techniques for small 
group management: activities in the form of games or contests, 

or discussions which could make the group move as a unit as well 
as mark individual progress. About 25 per cent of the teachers 
made no adaptation at all, treating a class of five or eight as 
if there were 20 or 30 present, and offering structured lessons 
as they would have done during regular day-school classes. But 
on the whole, the After School Study Centers were conducted in an 
atmosphere much more relaxed than their day-school counterparts, 
and this in itself seemed to make a difference to the children. 

Variations in the organization of the ASSC, teaching methods 
employed (clubs or classes), the way in which refreshment periods 
were handled (from no refreshments at all to up to 45 minutes' 
time consumed in "snacks"), the proportion of pupils who attended 
(from one-third to two-thirds of the enrollment) — all these 
variations were tremendous from school to school. In addition, 
there were few objective measures which could be used to judge the 
success of the program in terms of achievement. No school had set 
up a control program in the day school; and only one school had 
prepared questionnaires to go to the day-school teachers for the 
purpose of checking the progress of the pupil. 

The intangibles within the program were impossible to measure 
and. difficult to assess. Yet more than half the parents and 75 
per cent of the teachers thought the program was fruitful and 
worthwhile . 



CHAPTER V 



CONCLUSIONS AND RECOMMENDATIONS 



The quantitative findings of no systematic differences emerg- 
ing between performance in the five Special Primary Program schools 
and the several baseline, comparison schools, while clear, are 
neither definitive nor conclusive. The qualitative outcomes and 
their interpretation suggest definite advantages potentially accru- 
ing to the facilities and set-up of the Special Primary Program, 
including the ASSC. It seems a tenable hypothesis that, all other 
things being equal, including the teacher, the smaller the class 
group the greater will be the behavioral change, academically, 
culturally, and socially. Thus it would seem — almost by defini- 
tion — that the Special Primary Program is "working" in this 
sense. There is, however, one large qualifier, namely, that the 
measurements taken be appropriate to the behavioral changes intro- 
duced. and induced by the intervention program. 

Comments, recommendations, suggestions for future work in this 
area, and conclusions from the current findings follow. 

1. The Special Primary Program per se , even though an overlay 
and distillation of other programs, has been in effect only about 
nine months. From a research standpoint, one can hardly demand' 
definitive results from a complex program after such a short period. 
Intervention programs must be examined, in the long view, say, over 

a three- to five-year period. This point implies in the present 
context an extension of both intervention and assessment to grades 
five and possibly beyond. 

2. On the methods used for evaluation, a need exists for clari- 
fication and definition of the specific details of the program in 
terms of (a) extent^ and method of research; (b) administrative im- 
plementation; (cj the evaluations of those directly involved, namely 
school personnel, particularly teachers; and (d) the role of the 
parents. Without these detailed specifications, it is not at all 
obvious how the goals of the program can be achieved; far less, 

how rigorous evaluation can be conducted. 

Such matters as appropriate before-and-after measurements are 
essentials in a program like this. Equating of groups is also 
fundamental if the effects of several simultaneously operating 
programs are to be disentangled and "deconfounded." It would seem 
that careful research planning beforehand with heavy concentration 
on not more than two schools might well be advisable for future 
evaluation . 



3. A number of questions arise concerning the nature of the 
measuring instruments applied. The ones available stressed academic 
achievement, which is only one face of a many faceted die. There 
are specific questions about the appropriateness of the instruments 
themselves . For instance, several principals indicated independently 
that the children were being tested for the meaning of a large number 
of words to which they had never been exposed. A test for specific 
learned responses to specific stimuli obviously should present only 
previously experienced stimulus materials. In this sense, these tests 
fell far short of measuring achievement. 

4. The overall aim of the project should be clearly stated: 
instilling in the child the habit of learning- to-learn. If the 
purpose of education is to instill in the child a habit of seeking 
knowledge — call it "motivation” or whatever — then intervention 
programs should concentrate on teaching this generalized habit pat- 
tern. Assessment and evaluation by this token would focus on exami- 
nation of the degree to which the child’s learning-to-learn habits 
carry over, transfer, or generalize beyond the classroom situation. 
From a research standpoint it is basic that this direction be taken 
by such intervention programs as that under evaluative scrutiny. 

5. Overall planning is indicated for better utilization of 
parent and community resources to realize the full potential of this 
program. 

6. A reservoir of trained personnel is needed to fill the roles 
of specialists and members of clinical teams. The inability, to find 
and recruit appropriate personnel for many budgeted positions was a 
serious handicap to the program. 

7. A future evaluation might include a study of the specific 
effects of attendance at the ASSC program on the achievement and 
attitudes of pupils . 

8. With the modifications and alterations suggested, it is 
strongly recommended that the Special Primary Program be continued. 
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